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Tljo  method  or  for  finding  extrema  of  functions  subject  to  equality 

constraints  was  published  in  1788  in  the  famous  book  Mecanique  Analytique.  The 
works  of  Karush,  John,  Kulin  and  Tucker  concerninq  optimization  subject  to  inequality 
constraints  appeared  more  than  150  years  after  that.  The  purpose  of  this  paper  is 
to  call  attention  to  important  papers,  published  as  contributions  to  mechanics,  con- 
taining fundamental  ideas  concerninq  optimization  theory.  The  most  important  works 
in  this  respect  were  done  primarily  by  Fourier,  Cournot,  Farkas  and  further  by  Gauss, 
Ostroqradsky  and  Marrtel. 
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SI'iNIFICANCE  Af^D  EXPLANATION 

Thi3  a historical  papor.  It  concerns  the  necessary  conditions  of 
optimality  for  nonlinear  optimization. 

The  solution  of  nonlinear  proqramminq  problems  is  based  on  the  neces- 
sary conditions  formulated  for  the  case  of  equality  constraints  by  Laqranqe 
in  ilHH  and  for  the  case  of  inequality  constraints  by  several  authors 
between  1939  and  1950  (Karush,  John,  Kuhn,  Tucker).  This  paper  trios  to 
complete  the  qeneral  historical  picture  by  showing  that,  in  the  form  of 
contributions  to  mechanics,  the  basic  ideas  were  already  aiscovored  jointly 
by  Fourier,  Cournot  and  Farkas,  among  others. 

Many  referenced  papers  are  thoroughly  analyzed. 


The  responsibility  for  the  wording  and  views  expressed  in  this  descriptive 
summary  lies  with  MRC,  and  not  with  the  author  of  this  report. 


ON  'rut:  DEVELOPMENT  OF  OPTIMIZATION  THEOP.Y 


Andras  Prekoi>a 


* I , Introduction 

5 Farkas'  famous  paper  of  1902  published  in  Grelle's  Journal  became  a principal 

reference  concerning  linear  inequalities  after  the  publication  of  the  paper  of  Kuhn 

I 

and  Tucker,  "Nonlinear  Programming"  in  1950  (531.  In  this  latter  paper  the  funda- 
mental theorem  on  linear  inequalities,  Farkas'  theorem,  was  used  to  derive  necessary 
conditions  for  optimality  for  the  nonlinear  programming  problem.  The  results  obtained 
enabled  rapid  development  in  nonlinear  optimization  theory.  The  work  of  John  contain- 
ing similar  but  weaker  results  for  optimality  published  in  194ft,  has  been  generally 
known  but  it  was  not  until  a few  years  ago  that  Karush's  work  of  1939  became  widely 
known  whore  essentially  the  same  result  was  given  as  by  Kuhn  and  Tucker  in  1951. 

In  this  paper  we  call  attention  to  some  important  works  done  already  in  the  last 
century  and  before.  We  show  that  the  fundamental  ideas  concerning  the  necessary 
optimality  conditions  for  nonlinear  optimization  subject  to  inequality  constraints 
can  be  found  in  papers  primarily  by  Fourier,  Cournot,  Farkas  and  further  by  Gauss, 
Ostrogradsky  and  Hamel. 

To  start  to  disclose  the  early  development  of  optimization  theory  it  is  very 
helpful  to  have  a glance  at  the  first  two  sentences  in  Farkas*  paper  [231; 

"Die  naturgomasse  und  zugleich  systematische  Bohandlung  der  analytischen 
Mechanik  muss  das  zuerst  von  Fourier  und  dann  spater  von  Gauss  formulierte 
Ungleichheitsprincip  der  virtuellen  Verschiebungen  zur  grundlage  haben. 

Die  Moglichkeit  einer  solchen  Behandlung  erfordert  aber  gowisse  Konntnisse 
uber  die  homogencn  linearen  ganzen  Ungleichungen,  welche  bisher  so  zu  sagen, 
qanzlich  gefehlt  haben." 

Here  we  see  that  Farkas  had  a definite  purpose  for  developing  the  theory  of 
linear  inequalities.  He  was  professor  of  theoretical  physics  at  the  University  of 
Kolozsvar.  We  can  very  well  assume  that  he  himself  had  already  applied  his 
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inequality  theorem  to  the  problem  of  mechanical  equilibriim  and  in  fact  he  reported 


first  "on  the  applications  of  tiie  mechanical  principle  of  Fourier"  at  the  session  of 
the  Hungarian  Academy  held  on  Decomber  17,  1894.  This  was  published  later  in 
Hungarian  [111  and  in  the  German  language  [141.  We  shall  analyze  this  paper  later. 
First  we  have  to  say  a few  words  about  those  mechanical  principles  which  played  an 
imfjortant  role  in  the  develO|jmeuL  of  opLiniizaLion  Llieozy. 

2.  On  the  principles  of  mechanical  equilibrium 

The  principle  of  virtual  work  was  enunciated  by  Johann  Bernoulli  in  1717.  It 
appeared  first  in  a book  by  Varignon  in  the  same  year.  Let  us  quote  Lagrange 
(S5/I.p.21,22) : 


" Le  principe  des  vitesses  virtuelles  peut  etre  rendu  tres  general  de  cette 
maniere : 

Si  un  systeme  quelconque  de  tant  de  corps  ou  points  que  I'on  veut,  tires 
chacun  par  des  puissances  quelconques,  est  en  equilibre,  et  qu'on  donne  a 
ce  systeme  un  petit  mouvement  quelconque,  en  vertu  duquel  chaque  point 
parcoure  un  espace  infiniment  petit  qui  exprimera  sa  vitesse  virtuelle,  la 
somme  des  puissances,  multipliees  chacune  par  1 'espace  que  le  jjoint  ou  elle 
est  appliquee  parcourt  suivant  la  direction  de  cette  meme  pjuissance,  sera 
toujours  dqale  a zero,  en  regardant  comme  positifs  les  petits  espaces  par- 
courus  dans  le  sens  des  puissances,  et  conrie  neqatifs  les  espaces  parcourus 
dans  un  sens  oppose. 

Jean  Bernoulli  est  le  premier,  que  je  sache,  qui  ait  apercu  cette  grande 
generalite  du  principe  des  vitesses  virtuelles,  et  son  utility  pour  resoudre 
les  problemes  de  StaLique.  C'est  ce  qu'on  voit  dans  une  de  ses  Lcttres  a 
Varignon,  datee  de  1717,  que  ce  dernier  a placee  a la  tete  de  la  Section 
neuvieme  de  sa  Nouvelle  Mecanique,  Section  employee  tout  entiere  a montrer 
I par  differentes  applications  la  vSritS  et  1 'usage  du  principe  dont  il  s'agit." 
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Thi  - prill'  ij  !'•  w.r.  foiii.til'-r'-'i  l>y  L<i'}  r-<nq«*  as  ,in  dxiom  of  mt-oh.ini '’'i . p.i'p-  27  r.f  tin; 

: dDi  ■ WO)  k W*  • / > .ifJ  : 

*'C*ost  dans  cette  loi  que  consiste  ce  qu'on  appelle  c<^mniunomont  lo 
.orincipo  des  vitesses  virtuflles,  principe  reconnu  depuis  lonqtfjmps  pour 
le  principe  fondamontal  do  I'equilibre,  ainsi  que  nous  I'avons  montre 
(iaris  !a  Scjction  procedente,  ct  qu*on  pout,  par  t^ont^oqucruL,  zoqarder  conune 
une  espjece  d'axiomo  do  Mocanique. " 

F*or  the  case  of  a conservative  system  of  forces  i.e.  when  the  forces  are  given 
as  negative  partial  derivatives  of  a scalar  function,  the  principle,  first  enunciated 
by  Courtivron,  applies.  Concerning  this,  Lagrange  writes  the  following  f5Vr*»  p.701; 

”.,.ce  qui  donne  cet  autre  principe  de  Statique,  que,  de  toutes  les 
situations  quo  prend  s access i vement  le  systeme,  celle  ou  il  a la  plus  grande 
ou  la  plus  petite  force  vivo  est  aussl  celle  ou  il  le  faudrait  placer  d'abord 
pour  qu'il  restat  on  equilibre.  (Voir  Courtivron,  les  Memoires  de  l*Academie 
des  Sciences  do  174H  et  1749.1" 

Lagrange  gave  sufficient  conditions  that  the  potential  takes  it  minimum.  As  Bertrand 
remarked,  his  proof  was  incomplete  and  Dirichlet  later  gave  a correct  proof  110, 111 
for  the  theorem  involved. 

The  mechanical  principle  of  Fourier  was  first  published  in  1798  in  his  paper 
'*Menr)ire  sur  la  Statique".  This  concerns  the  case  of  inequality  constraints,  Farkas 
remarked  114,  ij.4581  that  the  declaration  of  the  inequality  principle  is  not  the  main 
contribution  of  the  paper.  In  fact  it  has  the  subtitle:  "Contenant  la  demonstration 
du  principe  des  vitf'sses  virtuelles".  This  very  general  "proof"  has  not  been  accepted 
as  a proof,  however  (see  e.g.  (75)),  thus  the  main  merit  of  the  paper  is  still,  con- 
trary to  Farkas'  remark,  the  declaration  of  the  inequality  principle.  We  quote 
page  4B8  of  Fourier's  paf>er  ( 341 1 


A 
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"Comme  il  arrive  souvent  que  les  fjoints  du  systeme  s'appuient  seulement 
sur  les  obstacles  fixes,  sans  y etre  attaches,  il  est  evident  qu'il  y a des 
deplacements  (xjssibles  qui  ne  satisfont  pas  aux  equations  de  condition  : on 
voit  encore  que,  par  ces  depjlacements,  le  moment  des  resultantes  est 
n&essai rement  positif,  puisque  la  direction  de  ces  forces  doit  etre 
perpendiculaire  aux  surfaces  resistantes.  Ainsi  la  somme  des  moments  des 
forces  appliquees  est  jxositive  pour  tous  les  deplacements  de  cette  espece; 
mais  il  est  impossible  que  I'on  derange  un  corpjs  dur,  en  equilibre,  de  sorte 
que  le  moment  total  des  forces  app^liquees  soit  negatif.  Au  reste,  si  I'on 
considere  les  resistances  conine  des  forces,  ce  qui  fournit,  comme  on  le  salt, 
le  moyen  d'estimer  ces  resistances,  le  corps  pout  etre  regarde  comme  libre, 
et  la  sommes  des  nvoments  est  nulle  pour  tous  les  dep>lacements  possibles." 


The  mfiment  of  the  forces  P,Q, K,  . . .actino  on  a mo'-.-hanical  system  is  defined  as 
the  sum  of  scalar  products 

(1)  PSp  + Qiiq  + Ric  + ... 

where  i5p,i)q,6r  are  variations  of  the  displacements.  In  a small  neighborhood  of 
the  point  describing  the  state  of  the  system  these  variations  - roughly  spoaking  - 
do  not  violate  the  constraints.  The  Bernoulli  principle  declares  (1)  to  be  equal 
to  zero,  while  the  Fourier  principle  declares  (1)  to  be  less  than  or  equal  to  zero 
in  case  of  equilibrium.  Fourier  was  using  the  "fluxion"  (as  it  turns  out  from  other 
[larts  of  his  pjapor)  instead  of  the  moment  (1),  these  two  being  negatives  of  each  other. 
This  exp/lains  why  Fourier  in  his  pjrincipjle  required  (1)  to  be  nonnegative. 

If  a pxjtential  V exists,  i.e.  if  we  have 


„ „ 3V,,  3V 

' 'ap'  ® “ '3q'  " "Sr'"' 


where  the  derivatives  on  the  right  hand  sides  denote  vectors,  then  the  requirement 


that  (1)  be  less  than  or  equal  to  zero  takes  the  form: 


On  the  left  hand  side  we  have  a total  di f ferential . A correct  mathematical  proof  - 
accordim  to  our  present  standard  - cannot  be  found  in  Fourier's  work.  We  know,  on 
the  other  hand,  that  (2)  cannot  be  derived  as  a necessary  condition  that  V takes  it 
minimum,  without  a constraint  cjualification.  Fourier  remarked  that  in  case  his 
principle  reduces  to  (2),  we  can  find  the  equilibrium  state  by  miniraizinq  ('.)  the 
function  V. 

In  1829  Gauss  (38)  aqain  enunciated  the  inequality  principle  without  mentioninq 
Fourier.  Gauss  seems  to  have  observed  the  necessity  of  a constraint  qualification. 

He  added  a footnote  to  the  enunciation  of  the  inequality  principle  where  he  required 
the  constraints  to  be  of  special  type.  We  quote  Gauss  [38,  p.23^1: 

"Na  ;h  dem  Princip  der  virtuellen  Geschwindiqkeiten  erfordert  dies 
Gleichqewicht,  dass  die  Summe  der  Producte  aus  je  drei  Factoren,  nemlich 
jeder  der  Massen  m,  m',  m"  u.s.w.,  den  Linien  cb,  c'b',  c"b"  u.s.w.,  und 
irqend  welchen  auf  letztere  resp.  projicirten,  vermo’qe  der  bedinqunqen  des 
Systems  mo'qlichen  Bewequnqen  jener  Punkte,  immer  = 0 sei,  wie  man  es  qewohnlich 
ausspiricht,  Oder  richtiqer,  dass  jene  Summe  niemals  fjositiv  werden  konne." 

Footnote; 

"Der  qewolinliche  Ausdruck  setzt  sti  1 Ischweiqend  solche  Bedinqunqen  voraus, 
dass  die  jeder  mo'qlichen  Bew>  qunq  entqeqenqesetzte  qleichfalls  moqlich  sei, 
wie  z.  B.,  dass  ein  Punkt  auf  einer  bestimmten  Flache  zu  bleiben  qeno'thiqt,  daris 
die  Entfernunq  zweier  Punkte  von  einander  unvera'nderlich  sei  u.  derql.  Allein 
dies  ist  eine  unnothiqe  und  der  Natur  nicht  immer  anqemessene  Deschrankunq . 

Die  fiberflache  eines  undurchdrinql ichen  Korpers  zwinqt  eincn  auf  ihr 
befindlichen  materiellen  Punct  nicht,  auf  ihr  zu  bleiben,  sondern  verwehrt 

\ 

ihm  bloss  das  Austreten  auf  die  Eine  Seite;  ein  qespiannter,  nicht  ausdehnbarer 
aber  bieqsamer  Faden  zwischen  zwei  Punkten  macht  nur  die  Zunahme,  nicht  die 
Abnahme  der  Entfernunq  iinmoqlich  u.  s.  w.  Warum  wollten  wir  also  das  Gesetz  der 
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virtuellen  f^Jeschwiridiqkeiten  nicht  liebf^r  qleich  anfanqs  so  ausdrucken,  dass  es 
alle  Fallo  urntasstV" 

This  requires  - accordinq  to  the  interpretation  of  the  author  of  this  paper  - that 
the  point  whore  the  equilibrium  is  reached  should  be  either  an  interior  point  of  the 
set  determined  by  the  constraints  or  a point  at  which  only  one  of  the  constraints  is 
active. 

In  the  year  18  54  at  a session  of  the  ’'Academic  Imperiale  des  Sciences  de 
Saint-Petersbourq" , Ostroqradsky  also  enunciated  the  inequality  pirinciple.  Voss 
remarks  175,  p.74J  that  "daher  heisst  in  Russland  das  Prinzip  von  Fourier  auch  wohl 
das  von  Ostroqradsky.”  It  is  interesting  to  read  what  Ostroqradsky  wrote  about  the 
inequality  principle: 

"II  est  tres  surprenant  de  voir  que  dans  la  nouvelle  edition  de  la  Mecanique 
analytique,  edition  publiee  a I'epoque  ou  I'on  connaissait  deja  toute  I'etendue 
du  principe  des  vitesses  virtuelles,  Laqranqe  non  seulement  n'a  fait  aucun  usage 
de  1 'observation,  que  dans  I'equilibre  des  forces  le  moment  total  pouvait  acquerir 
une  valour  negative,  mais  qu'il  I'a  en  quelque  sorte  ecartee  quand  elle  s'est 
presentee  comme  d'elle  memo,  dans  la  demonstration  qu'il  a donnee  du  principe  des 
vitesses  virtuelles;  cependant,  faute  d'y  avoir  eu  eqard,  ce  grand  qeomfetre  a 
incompletement  enumere  les  deplacemens  possibles  dans  la  plupart  des  questions 
de  la  premiere  partie  de  la  Mecanique  analytique,  et  il  est  facile  do  reconnaitro 
que  les  deplacemens  qu'il  a neqliqe  de  considerer,  ne  sont  empeches  par  aucune 
condition,  en  sorte  que,  toutes  les  equations  qu'il  a Stabiles  pour  I'Squilibre 
etant  satisfaites,  I’equilibre  cependant  pourrait  n'avoir  pas  lieu. 

Nous  nous  proposons,  dans  ce  memoire,  d'exposer  I'analyse  relative  a I'emploi 
du  principe  des  vitesses  virtuelles  considere  dans  toute  sa  qenSralite  et  de  com- 
pleter la  solution  de  plusieurs  questions  traitees  dans  la  premiere  partie  de  la 
Mecanique  analytique." 
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La  :rar.'u-s ' s mothofi  of  mul tij.*! iers  was  publishr-d  in  thfj  first  volvimo  of  Mocanique 
Ar.al'/tiquo  77-79)  as  a tool  to  find  the  equilibrium  of  a mechanical  system  using 

Bernoulli's  principle.  The  validity  of  the  method  was  proved  by  Lagrange  entirely  on 
an  algebraic  basis.  (This  ingenious  method  was  unable  to  attract  mathematics  students 
and  teachers  for  a long  time.  The  method  of  presentation  used  nowadays  by  many 
instructors  is  to  prove  first  the  necessary  condition  in  case  of  inequality  constraints, 
qiv<^  a geometric  meaning  to  this  and  then  refer  to  the  case  of  equality  constraints. 

This  can  ma)ce  the  students  more  enthusiastic  toward  this  theory).  We  shall  see  in 
Sections  4-7  what  happened  to  Fourier’s  principle.  Now  we  devote  a few  pages  to 
Far)cas'  theorem. 

3.  The  theorem  of  Farkas  on  linear  inequalities 

Gyula  Farkas  was  born  in  Sarosd,  Hungary,  in  1R47  and  died  in  PestszentloVinc, 
Hungary,  in  1930.  First  he  studied  law  at  the  University  of  Budapest  and  music  at  the 
same  time  until  ho  decided  to  study  mathematics  and  physics  at  the  Faculty  of  Philosophy. 
He  received  a high  school  teacher's  diploma  in  1876.  He  became  a professor  of  theo- 
retical physics  at  the  University  of  Kolozsvar  in  1887  and  held  this  position  until 
1915.  He  was  active  in  organization  too,  holding  the  positions  of  dean  of  his  faculty 
and  of  rector  of  the  university  for  some  time.  In  1898  he  was  elected  a corresponding 
member  and  in  1914  an  ordinary  member  of  the  Hungarian  Academy  of  Sciences.  Due  to 
increasing  eye  disease  he  decided  to  retire  from  his  professorship  and  moved  to 
Pestszentlo’rinc  in  1915.  As  a young  man  he  wrote  several  studies  in  numerical  analysis, 
differential  equations,  elliptic  functions  and  music  theory.  His  most  important 
scientific  contributions  are  those  concerning  the  mechanical  principle  of  Fourier,  the 
theory  of  linear  inequalities  and  various  problems  of  thermodynamics.  Commemorating 
him  in  1974,  the  Janos  Bolyai  Mathematical  Society  founded  a Farkas  prize  to  honor 
young  mathematicians  for  their  scientific  contribution  to  applied  mathematics.  For 
further  information  concerning  the  life  and  work  of  Farkas  see  (32,33,65,66,731. 


i 

I 

- f 

1 


i 

i 


» < 

’ I 

:i 

i 


Parkas'  1902  paiJCt  1211  is  gc-norally  referred  to  concerning  the  fundamental 

theorem  on  homogeneous  linear  inequalities.  In  what  follows  we  shall  write  vectors 

in  column  form  and  the  transi-.  ie  will  be  denoted  by  a prime. 

Let  g , . . .g  ,g  denote  m-component  vectors  and  form  the  following  homogeneous 
1 M 

linear  inequalities: 

(3.1)  g^x  ^ 0, i = 1 , . . . ,M, 

(3.2)  g'x  i 0. 

If  (3.2)  holds  for  every  x for  which  all  inequalities  in  (3.1)  hold,  then  we  say 
that  the  inequality  (3.2)  is  a consequence  of  the  system  of  inequalities  (3.1). 
Parkas'  theorem  is  the  following. 

Theorem  i.l.  The  inequality  (3.2)  is  a consequence  of  the  inequalities  (3.1) 

if  and  only  if  there  exist  nonnegative  numbers  X ,...,A  such  that 

1 M 


g = + •••  ^ V(.- 


Parkas  published  this  theorem  first  in  1895  |13,14].  However,  that  proof  con- 
tains a gap.  He  gave  the  first  good  proof  in  1896  in  the  paper  115)  published  in 
the  Hungarian  langua je.  Essentially  the  same  paper  appeared  in  German  in  1899  117). 
Following  this  first  proof,  he  gave  a simple  proof  and  published  it  in  German  119). 
TTiis  latter  proof  is  included  in  his  best  known  Crelle's  Journal  paper  123). 

Very  likely  Farkas  never  recognized  that  it  is  net  at  all  easy  to  complete  his 
first  proof.  In  a paper  (29)  which  appeared  in  1918  he  wrote  that  there  are  six 
proofs  for  this  theorem.  He  referred  to  the  works  of  Minkowski  160)  and  Haar  142) 
to  three  proofs  mentioned  above  and  to  a proof  given  in  his  university  lecture  notes 
(not  available  to  the  author  of  this  pape-,).  His  last  paper  on  linear  inequalities 
(31)  appeared  in  1926  (a  short  paper  on  some  geometrical  aspects  of  his  theorem). 

It  is  instructive  to  see  what  kind  of  error  he  made.  We  shall  quote  from  1 14). 
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Kirst  he  show5i  that  we  may  supjioso,  that  there  are  afj  marty  linearly  inrlepenrler.t 


I 


» 

i 

i 

t 

1 


ineqtia I i t ies  in  the  system  (of  which  one  consequence  is  considered)  as  the  n'imber  of 
variables.  Ifien  he  represents  the  coefficient  vector  of  the  consequence  inequality 
as  a linear  combiriation  of  tl»e  other  coefficient  vectors.  ;Jow,  if,  for  the  sake  of 
simplicity,  the  first  n inequalities  are  linearly  independent,  then  we  can  express 
the  multipliers  helonqinq  to  these  in  terms  of  the  others  in  the  followinq  manner 

A * + I X + ^ -f  . . . 

10  1 n-tl  2 n+2 


(3.4) 


A^  = K + K A + K^A  ^ 
201  n+l  2 n+2 


A = . . . 

n 


*^arkas  continues  to  write  114,  p.  270): 


"Mur  dann  ist  es  unmo’qlich,  dass  alle  A*-Gr6ssen  zuqleich  nicht-neqati ve 
Werte  erhalten  konnen,  wenn  in  (8)  ((3.4)  in  this  paper,  A.P.)  wenigstens  eine 

rechte  Seite-  oder  eine  Summe  von  nicht-neqativen  vielfachen  der  rechten  Se « : ».  n 
die  doppelte  Beschaf fenheit  aufweist,  dass  ihr  erstes  Glied  Negativ  ist,  und 

die  Coef f icienten  ihrer  Cibrigen  Glieder  entweder  negativ  sind,  oder  hochstens 
verschwinden  (da  durch  Eliminationen  pxjsitiver  Glieder  mittels  entsprechender 

neqativen,  aus  einem  mit  positiven  A durchaus  unerful Ibarem  Teile  von  (5) 

((3.2  in  this  paper,  A.P.)  nach  und  nach  aequivalente  Teil-Systeme  erhalten 
w(3rden  konnen).  In  diesem  Falle  hat  aber  (4)  ((3.1)  in  this  paper,  A.P.)  schon 
Auflosungen,  durch  welche  (5)  ((3.2)  in  this  paper,  A.P.)  nicht  befriedigt  wird. 

•Sei  es  nainlich,  dass  diese  doppelte  Eigenschaft  der  rechten  Seite  der  ersten 
Gleichung  in  (8)  ((3.4  in  this  paper,  A.P.)  zukommt,  dass  also 


Farkas  anticipated  the  procedure  applied  in  the  dual  simplex  method.  We  know, 
however,  that  cycling  is  f)ossible  there  (2).  By  the  application  of  the  lexicographic 
dual  method  (57)  (a  short  presentation  is  given  in  (701)  we  ran  correct  the  f*roof. 

Let  us  summarize  the  whole  corrected  proof  briefly. 

-9- 


I 


Proof  of  Farkas'  theorem.  First  Wf  remark  that  if  we  apply  a linear  transforma- 
tion y = Bx,  where  B is  a nonsinqular  square  matrix,  in  the  inequalities  (3.1), 
(3.2),  then  the  new  (3.2)  inequality  will  be  a consequence  of  the  new  (3.1)  system. 
Furthermore,  proving  Farkas’  theorem  for  the  new  inequalities,  we  see  that  (3.3)  is 
satisfied  with  the  same  nonnegative  multipliers 

Let  us  assume  first  that  the  system  (3.1)  contains  as  many  linearly  independent 
relations  as  the  number  of  variables.  Consider  the  linear  programming  problem: 

minimize  (01  + ...  + 0)  ) 

1 M 

subject  to 

1 g + ...  + X g = g, 

11  M M 

i 0.  • • • i 0- 

Starting  from  any  basis  and  applying  the  lexicographic  dual  method,  at  the 

end  we  reach  a system  of  the  form  (3.4)  where  either  > 0,  > 0,...  or  there 

exists  a row,  where  on  the  right  hand  side  the  first  term  is  negative  and  all  vari^lbles 

there  have  positive  or  zero  coefficients.  The  second  case  cannot  occur.  In  fact  the 

lexicographic  dual  method  guarantees  that  the  column  vectors  of  (3.4)  are 

obtained  from  the  vectors  g,  ,...>g,,>g  by  a nonsingular  linear  transformation,  thus 

1 M 

the  system  of  linear  inequalities  (in  the  variables 

^2  - 


has  the  consequence 


flow,  if  o,(j,  we  had  ^ ^2  ^ then  the  vector  of  comfx^nents 

y , = J » y ,=  •••*  y = O would  satisfy  (3.6)  and  would  not  satisfy  (3,7), 

12  n 

If  in  (3.1)  we  have  h('M)  linearly  independent  relations  and  (for  the  sake 

of  simplicity)  are  linearly  independent,  then  we  choose  n-comfx>nent 

1 h 

vectors  d,  , . . . ,d  . so  that  B * (q  , . . . ,q  , d , . . , ,d  , ) be  a nonsinqular  matrix 
1 n-h  1 hi  n-h 

and  apply  the  transformation  y * Bx  for  the  incqualiticc  in  (3.1)  and  ('*.'?).  mh<ap 

(3.1)  will  depend  only  on  since  the  inequality  in  (3.2)  is  a consequence 

of  the  former  ones,  y ,...,¥  will  have  zero  coefficients  also  there.  Now  we  can 
h + 1 n 

forqet  about  y.  y and  apply  the  above  reasoninq  to  the  system  of  variables 

h+1  n 

yi»'**/y.  . At  the  end  we  can  reestablish  y.  Y everywhere  with  zero  coefficients 

I h h+1  n 

and  reach  the  oriqinal  inequalities  by  setting  y * Bx. 

Thus  we  have  proved  Farkas*  theorem.  We  have  also  proved 

Theorem  3.2,  If  (3.2)  is  not  a consequence  of  the  system  (3.1),  then  there  is  a 

linear  transformation  y * Bx  with  nonsinqular  square  matrix  B such  that  for  at 

least  one  i,  the  variable  has  negative  coefficient  in  the  new  inequality  (3.2) 

and  has  nonriGgjtive  coefficients  in  the  new  system  (3.1). 

The  proof  given  by  Farkas  in  [15)  for  his  theorem  can  be  summarized  as  follows. 

First  we  observe,  that  if  we  use  a transformation  v « Bx,  where  B is  a nonsinqular 

square  matrix,  then,  proving  the  theorem  for  the  obtained  inequalities  with  the  variable 

v,  we  also  prove  it  for  the  original  inequalities  (the  X factors  can  be  taken  the  same 

in  both  cases).  L^t  x ^ and,  using  induction,  assume  that  the  theorem  is  true  for 

every  positive  integer  smaller  than  n.  For  n * 1 the  assertion  holds  trivially.  We 

may  assume  that  g 0 (otherwise  the  assertion  is  trivial) . Introduce  the  nonsinqular 

transformation:  * ^2''‘’''^n  * ^n^  compact  form:  v = Bx.  Then 

V > 0 is  a consequence  of  the  inequalities  h*v  =*  q*B  ^v  > 0»  . . . *h.'.v  = g'B  ^v  > 0. 

In  these  inequalities  there  must  be  at  least  one,  in  which  v^^  has  positive  coefficient, 

because  otherwise  ^ 0 would  not  be  a consequence.  If  the  first  k of  these 

inequalities  have  that  property,  then  already  the  inequalities 

h,,v,  + . ..  + h,  V ^ ^ 

11  1 In  n 


+ ..  . + h^  V >0 
kl  1 kn  n “ 





have  the  consequence  ^ 0.  Consider  the  following  inequalities  in  the  n - 1 


variables  v_,...,v  : 

2 n 


h, ,v  + . . . + h V ^0, 

12  2 In  n ■= 

(3.9)  - 

h,  „v,  + . . . + h,  V > „ 

)i2  2 kn  n 0. . 

At  least  one  of  them  must  be  identically  zero,  because  otherwise  we  could  find  such 

v,,...,v  , for  which  all  inequalities  in  (3.9)  were  strictly  positive  but  then 
2 n 

Vj^  ^ 0 would  not  be  a consequence  of  the  system  of  inequalities  (3.8).  Now  we  use 
Farkas'  theorem  for  the  case  of  n - 1.  Starting  from  (3.9),  we  assume  that  the 
first  relation  is  identically  zero.  Then 

(3.10)  -h^^v^  ....  - h^^v^  > 0 

is  a consequence  of  (3.9),  thus  there  exist  nonnegative  numbers  such  that 

(Ui  t l)h^2  ^ ‘'2‘'22  t ...  + “^h^^  ' °' 


(w,  + l)h,  + W-h,  + ...  + W,  h,  « 0 . 
1 In  2 2n  k kn 


This  implies  that  there  exist  > 0,...,X|^  ^ 0 such  that 

^Ni  ^ ^^1  ^ •••  " Vki  * 

... 


Setting  i 


A h + •••  * * 0 , 

1 In  2 2n  k kn 

♦ • 0,  the  assertion  follows  for  the  case  of  n and  thus  the 


’ k*l  M 

proof  is  complete. 

4 . Necessary  condition  for  the  equilibrium. 

We  consider  a mechanical  system  the  state  of  which  is  described  by  the  vector 
X f r"  which  is  subject  to  the  following  constraints: 

(4.1)  g^(x)  0,  i - l,...,m. 

Denote  by  X,,...,X  the  components  of  the  forces  acting  on  the  system  and  suppose 
1 n 

that  at  X*  equilibritxn  is  reached,  "rtien  by  Fourier's  principle  the  inequality 

(4.2)  X,6x,  + . . . + X «x  <0 

11  n n 


is  satisfied,  where  Sx,,...,Sx  are  variations  of  the  coordinates  x,,...,x  i.e. 

In  In 


small  quantities  with  the  property  that  the  vector  of  components 

* * 

, . ,,  X,  + ix, , . . . ,x  + 6x 

(4.3)  11  n n 


satisfies  approximately  (4.1).  In  what  follows  we  shall  use  general  terms  but  there 
are  not  very  restrictive  mathematical  conditions  under  which  our  statements  can  be 
made  exact. 


linear  inequality  (4.4)  is  a consequence  of  the  system  of  linear  inequalities  (4.5), 

hence  by  Far)cas'  theorem,  there  exist  nonnegative  numbers  > • • • such  that 

1 M 

(4.6)  X + ^,'7g  (x  ) + + X Vg  (x  ) = 0 

i i MM 


If  the  system  of  forces  is  conservative,  i.e.  there  exists  a function  V(x)  so  that 
at  every  point  of  the  state  space  we  have 


Here  on  the  left  hand  side  we  have  a total  differential.  Having  a potential,  we  can 


i 


start  from  (4.8),  by  applying  Courtivron's  principle,  stating  that  if  a mechanical 
system  is  in  stable  equilibrium,  then  the  potential  has  a local  minimum  and  observing 
that  (except  for  pathological  cases)  the  total  differential  is  nonnegative  at  the 
minimum  point  of  the  function. 

We  can  ask:  who  were  the  persons  - if  any  - who  inferred  the  equation  (4.6) 
from  the  inequality  principle  for  the  mechanical  equilibrium?  To  answer  this  question 
we  can  start  by  analyzing  the  papers  referenced  by  Farkas  in  his  Crelle's  Journal 
paper  (23i,  and  it  is  also  advisable  to  have  a look  at  the  volumes  of  Enzyklopadie 
der  Mathematischen  Wissenschaf ten  published  at  the  beginning  of  this  century.  In  the 
four  volumes  written  on  mechanics  there  are  two  papers  where  theories  of  statics  and 
dynamics  under  inequality  constraints  are  mentioned.  The  authors  of  these  two  papers 
are  Voss  1 75)  and  Stacl<^el  171).  By  Farkas  and  these  two  about  thirty  books  and  papers 
are  referenced.  Some  of  them  are  unfortunately  not  available  to  the  author  of  this 
paper,  but  Farkas,  Voss  and  Stackel  together  very  likely  give  a good  picture  about  the 
history  of  the  subject.  Voss  writes  (75,  p.74l! 

"Auf  diesen  von  Ligrange  nicht  berucksichtigten  Fall  hat  unabhangig  von 
Fourier  erst  wieder  Gauss  dann  Ostrogradsky  hingewiesen. . . daher  heisst  in 
Russland  das  Prinzip  von  Fourier  auch  wohl  das  von  Ostrogradsky.  In  Frankr^ich 
ist  Fourier’s  Prinzip  nicht  so  unbeachtet  geblieben;  A.  A.  Cournot  entwickelt 
schon  in  1827  die  gleichungen  von  Ostrogradsky:  " 

One  paper  by  Ostrogradsky  is  also  referenced  by  Farkas:  this  paper  is  [671. 
Stackel  inentions  (68)  too. 

Voss  does  not  refer  to  Farkas  but  Stackel  references  the  papers  (14>16l.  We  can 
forgive  that  Stackel  does  not  recognize  the  importance  of  Farkas'  work  because  the 
subject  of  his  paper  is  "Elementare  Dynamlk".  The  work  of  Mayer  is  highly  esteemed 
by  Stackel: 
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"Statt  holonoroer  odor  nicht  holonomor  hodinqunqnqloichunqon  konnon  auch 
Hfdinqunqsiinqleichheiten  auftreten;  auch  konnori  ho-dinqunqen  plo'tzlich  fortfallen 
odor  plotzlich  durch  aridore  orsetzt  worden.  Nachdem  boreits  fruher  solche  FaTle 
bohandclt  wordon  waren,  hat,  durch  E.  Study  anqoreqt,  A.  Mayor,  vom  Gausschen 
f'rinzipe  dos  kloinsten  Zwariqes  ausqehend,  darqoloqt,  wie  man  hier  die  Bewequnq 
dos  Punktes  in  alien  Fallen  bestimmen  kann." 

The  excellent  papers  by  A.  Mayer  referred  to  (58,591  handle  dynamical  problems, 
therefore  are  only  partially  relevant.  However,  it  is  very  instructive  to  read  these 
papers  containing  interesting  ideas,  good  examples  and  proofs  of  nonnegativity  of  the 
multipliers  in  special  cases.  Zermelo  [761  gave  an  interesting  proof  for  more  general 
cases.  Farkas  gave  the  most  general  form  of  the  theory  in  [241.  Among  the  papers 
containing  solution  to  dynamical  problems  subject  to  inequality  constraints  [191 
should  also  bo  mentioned. 

Fourier,  Cournot  and  Farkas  seem  to  be  the  principal  contributors  to  the  present 
form  of  the  necessary  condition  of  static  equilibrium.  Cournot  (and  later  Ostroqradsky ) 
presented  the  equations  (4.6)  in  the  form  of  a conjecture  (as  we  may  say  now).  Farkas 
proved  (4.6)  by  relying  on  Fourier's  work  concerning  the  first  part  of  the  theorem 
(considering  now  conservative  system  of  forces)  where  - as  it  is  obvious  today  but  did 
not  seem  necessary  for  those  in  the  last  century  dealing  with  mechanical  problems  - a 
constraint  qualification  is  needed.  We  have  to  add  to  these  that  the  work  of  Cournot 
was  based  to  a great  extent  on  the  work  of  Poinsot  [69[. 

Fourier  and  Farkas  both  contributed  further  important  ideas  to  optimization  theory. 
I.et  us  summarize  briefly  their  principal  results  in  this  respect. 

Fourier  - anticipated  the  formulation  of  the  linear  progrcimming  problem 
(36/11.,  p.  125-1281,  (401; 

- formulated  the  inequality  principle  for  the  mechanical  equilibrium  [141: 

- initiated  the  parametric  solution  of  homogeneous  linear  inequalities  (15). 


I 

Farkas  - proved  the  basic  theorem  concernitifj  homfxjeneous  linear  inequalities;  first  j 

in  (15); 

- gave  a rigorous  proof  for  the  "dual  form"  of  Fourier's  mechanical  inequality 
principle  (14,15); 

- gave  an  elegant  parametric  representation  for  the  solutions  of  homogeneous 
linear  inequalities;  first  in  (19). 

5 . The  work  of  Cournot  on  the  problem  of  equilibrium  i 

Antoine-Augustin  Cournot  (1801-1877)  famous  polyhistor,  was  one  of  the  greatest 

I 

mathematical  economists.  The  work  of  his  which  we  are  analyzing  here  was  done  as  a 

contribution  to  mechanics.  It  is  interesting  to  remark  that  in  his  famous  book  , 

1 

"Rechorches  sur  les  Principes  Mathematiques  de  la  Theorie  des  Ri chesses"  no  application 
can  be  found  of  his  previous  investigation  on  the  problem  of  mechanical  equilibrium. 

Since  the  first  publication  of  this  book  several  editions  have  appeared  e.g.  (7)  with 
the  critiques  of  Walras  Bertrand  and  Pareto,  and  introduction  and  biographical  notes 
by  Lutfalla,  further  (8)  with  the  notes  of  Irving  Fisher. 

Cournot  became  docteur  es  sciences  in  1829  in  Paris.  His  thesis  (5,6)  contributed 
to  dynamics,  where  he  applied  his  earlier  result  published  in  1827(4).  One  year  earlier 
he  published  an  elementary  paper  (3)  on  inequalities;  there  is  no  anticipation  in  that 
paper  of  any  form  of  Farkas*  theorem. 

In  the  paper  (4)  that  is  at  present  most  important  for  us,  Cournot  does  not  refer 
to  the  work  of  Fourier.  He  seems  to  have  been  unaware  of  the  enunciation  of  the 
inequality  principle  by  Fourier  in  1798.  Cournot  rediscovered  the  principle  but  also 
derived  the  necessairy  conditions  for  the  equilibriun.  We  quote  from  his  short  pap<!r 
(4,  p.166)! 

"...il  arrive  souvent  que  les  liaisons  du  systeme  ne  peuvent  etre  exprimces 
par  des  equations;  il  resulte  de  ces  liaisons  des  conditions  d'equilibre  que 
I'on  a toujours  refjardees  comma  no  pouvant  se  deduire  du  prlncipe  des  vitesses 

( 
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Vi r tu<;  1 1 f-'S  et  <ji.ant  on  '■iohors  flo  co  principe  (Mocarii'pjo  do  M.  Poisson,  tom.  I, 
p.  241).  Notro  but  est  ici  do  faire  voir  quo,  lorsque  les  liaisons  du  systomo 
pouvont  s'ox  primor  a Iqobriquomont  par  le  moyen  do.s  siqnos  d'inoqalito,  )o 
prinoipo  dos  vitossos  uirtuollos,  convenablemont  modifie,  s'y  apipliquo  onooro, 
ot  fournit,  par  uno  mothodo  uniformo,  los  conditions  do  1 ' oqui 1 ibre . " 

On  paqos  IbV  and  IfjH  of  the  same  pjaper  wn  read  further: 

"Admottons  qu'un  systemo  soit  soumis  a un  certain  nombre  do  liaisons 
somblables,  exprimeos  par  los  ineqalites 

I > 0,  I’  > 0,  etc.  J -■  0,  J'  0,  etc. 
les  siqnos  > et  ' etant  toujours  .supposes  no  pas  exclure  le  cas  d’eqalite. 

On  no  peut  pas,  en  qoneral,  differentier  une  ineqallte  commo  uno 
oquation,  ni  en  doduire  une  relation  entre  les  Incremons  dos  variablos;  mais 
lorsqu'il  s'aqit  do  la  recherche  des  conditions  d'equilibre,  deux  cas  seulement 
fx:uvont  se  presenter.  Ou  la  situation  du  systeme  est  telle  quo  I'on  pourrait 
supprimor  les  liai.sons,  sans  chanqer  son  etat,  comme  il  arrive,  si  los  fils  qui 
joiqnent  cortains  do  sos  f'oints  ne  sont  pas  tendus,  ou  si  les  points  auxquels 
cortaines  surfaces  opjfxjsent  des  obstacles  impenetrables,  ne  sont  jjoint  contiqus 
a cos  surfaces:  dans  ce  cas  I'equilibre  doit  avoir  lieu,  independamment  des 
conditions  do  liaison,  et  il  est  sufjerflu  d'en  tenlr  comptc;  ou  bien  le 
systomo  ost  place  do  maniere  a co  quo  les  liai.sons  fjroduisent  leur  effet,  et 
puissent  diminuer  le  nombre  des  conditions  necessaires  pour  I'equilibre:  alors 
on  a fxjur  les  valours  actuelles  des  coordonnees  I • 0,J  • 0,  etc.,  et  si  I'on 
fait  varler  cos  valeurs,  leurs  incremons  ne  seront  pas  entlerement  arbitraires; 
ils  dovront,  en  vertu  des  conditions  primitives,  satisfairc  aux  relations: 

I » 

(a)  a:  > 0,41  > 0,  etc.  6J  ' 0,4J  < 0,  etc. 

D'ailleurs,  quand  le  systeme  est  soimis  a des  liaisons  de  I'espece  de 
celles  quo  nous  considerons  ici,  il  est  clair  qu'on  pourrait  les  supprimer, 
pourvu  qu'on  lui  appliquat  certaines  forces,  capables  d'en  tenir  lieu;  ainsl 
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la  resistance  d'uno  surface  peut  etre  remplacee  par  1 ' appl icat ion  d'une  force 
normale  a cette  surface  et  diriqee  dans  le  sens  convenable,  celle  d'un  fil 
tendu,  par  1 ' appl ication  d'une  force  dirigee  dans  le  sens  de  la  tension  du  fil, 
etc.  .loient  F,F',....les  forces  directement  apipliquees  au  systeme,  suivant  les 
directions  f,f',....et  P,P',...les  forces  auxiliaires  qui  tiendraient  lieu  de 
I'existence  des  obstacles,  et  spraient  dirigees  suivant  les  lignes  p,p'..,.: 
on  aura,  en  vertu  du  principe  des  vitesses  virtuelles,  I'equation  fondamentale 
F^f  + F'6f'  + etc.  + P6p  + P'6p'  + etc.  = 0. 

Or  il  est  aise  de  voir  que  tous  les  mouvemens  virtuels,  pour  lesquels 
P et  lip.P'  et  4p',  etc.,  seraient  de  signes  contraires,  tendraient  a suntionter 
les  obstacles  que  les  surfaces,  les  fils,  etc.,  opposent  aux  differens  points 
de  systeme,  et  par  consequent  sont  incompatibles  avec  les  liaisons  du  systeme, 
exprimees  par  les  in^alites  (a).  II  n'y  a de  compatibles  avec  ces  liaisons 
que  les  mouvemens  {x>ur  lesquels  P et  4p,P'  et  4p'  sont  de  meme  signe,  et  fx>ur 
lesquels  par  consequent  les  quantites  P4p,P’6p',  etc.  sont  essentiellement 
pos i t i ves . " 

The  "proof"  given  by  Cournot  for  his  equations  is  only  a short  reference  to  our 
imagination.  When  dealing  with  the  special  case  of  a system  of  points  positioned  on 
planes  parallel  to  the  xy-plane,  Cournot  refers  to  the  work  of  Poinsot  (691,  first 
published  in  1803.  In  fact,  for  this  special  case  Poinsot  already  obtained  the 
conditions  of  equilibrium.  Assume  for  the  sake  of  simplicity  that  one  body  is 
supported  at  the  points  A,B,C,D,...,  by  a plane  parallel  to  the  xy-plane.  On 
page  125  of  (69)  we  read: 

"...toutes  les  forces  appliquees  au  systeme  doivent  se  reduire  a une  seule, 
pcrpendiculaire  au  plan  fixe,  et  dont  la  valeur  ne  soit  pas  positive. 

En  second  lieu,  je  dis  que  sa  direction  doit  rencontrer  ce  plan  dans 
I'interieur  du  polygone  forme  par  les  points  d'appui  A,B,C,D, . . . . " 
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Th**  p.iptTs  of  Cournot  to  b<.*  loss  woll  known  thon  his  other  works. 

Th»'y  .ir'*  not  listed  in  the*  bib  I ioc^raphy  of  his  works  piiblishod  in  |71. 

'**^.*S^  of  Ofit r(j<j radsky  on  thfr  problem  of  equilibrium 
Mikhuil  Vasilevich  Ostro^radsky  (lH01-lRf)2)  contributed  im{)ort«int  result.';  (anv)nq 
others)  to  m<*chanics.  He  was  a student  in  Paris  and  attended  the  courses  of  Fourier, 
Poisson,  Caucrtiy  and  other  well-known  French  mathematicians.  Me  returned  to  Hussia 
(.St.  P»'t<T'ibur'|)  in  1H2H.  In  1B30  he  became  an  extraordinary  memtier  and  in  1812  an 
ordinary  miml«‘r  of  the  Academy  of  St.  Petersburq. 

Two  papers  of  Ostroqrad.sky  should  be  mentioned  concerninq  the  problem  of  mechanical 
equilibrium.  Farkas  refers  only  to  (67)  (presented  in  1834  before  the  Academy)  but  the 
other  \(,h\  is  an  improved  version  of  his  theory.  In  the  earlier  paper  four  apj^l ications 
are  mentioned:  a.)  a point  that  is  allowed  to  move  in  one  part  of  the  space  subdivided 
by  a surface;  b. ) the  funicular  polygon;  c. ) the  flexible  file;  d. ) the  incompressible 
liquid.  Further  problems  are  mentioned  concerninq  dynamics. 

In  (68l  Ostroqradsky  refers  to  (what  we  call  now)  Farkas'  theorem  a.s  an  obvious 
algebraic  fact  and  derives  the  equation  of  equilibrium  (4.6).  We  reproduce  here  part 
of  the  Images  589  and  590  of  f 68)  : 

"Supfiosons  que  les  quantites  6s,6s' ,6s",(Ss"*,  . . . . appartiennent  non 
seulemcnt  a ceux  des  deplacemens  du  systfeme,  dont  les  forces  perdues  sont 
cafiables,  mais  encore,  a tous  les  autres  deplacemens  tant  possibles  quo  non, 

ou  plutot  considerons  6s,  6s* , 6s"  , 6s"*, comme  tout-a-fait  arbitrairos. 

Nous  dovons  exprimor  que  les  forces  perdues  R,  R* , R" , R"', . . . . sont  incapables 
do  produire  aucun  .leplacement  des  systfemes  satisfaisant  aux  conditions 

6L  > 0 
6L^  > 0 
6L2  > 0 
6L^  > 0 

le  siqne  > n*exclut  f>oint  celui  de  l*^alite. 
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Or  on  salt  qu'un  systeme  des  forces  est  capcdsle  de  tout  deplacemont  qui 
fournit,  pour  son  moment  total,  une  valeur  positive  et  aucun  de  ceux  qui  corres- 
pondent aux  valeurs  negatives  ou  zero  du  moment  total.  Ainsi,  pour  que  les 
forces  perdues  soient  incapables  de  produire  aucun  des  deplacemens  satisfaisans 
aux  conditions  (15),  il  faut  que  leur  moment  soit  negatif  ou  zero  pour  ces 
deplacemens,  c'est-a-dire  il  faut  que  la  fonction 

RSsoostj;  + R'iSs'cosij,'  + R”6s"cosil,"  + R”' Ss”' cosij,’''  + 

dans  laquelle  ^ ' ,i;i " ,i<) designent  respectivement  les  angles 

A A /\ 

RiSs,  R' <s ' , R'’6s” , R”’ Ss"'  , . . . . et  qui  par  consequent  represente  le  moment 

des  forces  R,R',R",R"'  soit  negative  ou  z6ro  toutes  les  fois  que 

6s,  6s* , Ss",  5s'"  , . . . . remplissent  les  conditions  (15). 

La  solution  de  la  question  qui  consists  a rendre  la  fonction 

R6scosili  + R'6s'cosi(/'  + R"6s"cosi)<"  + R'"  ds'"  cosi))'"  + 

negative  ou  zero  toutes  les  fois  que  les  fonctions  de  meme  nature, 

6L^,....  sont  positives  ou  z4ro,  appartient  ^ I'algfebre  la  plus  elementaire. 

Il  est  necessaire,  et  il  sufflt  que  R6scosi(i  + R'6s'cosi//'  + R"6s"cosi))"  + 

R",  cosi(/"'  + puisse  se  reduire  a une  fonction  lineaire  de  6l,6l^, 

. . . . avec  des  coefficiens  neqatifs.  Ainsi  il  n'y  a qu'a  faire,  quels 

que  soient  6s,  6s' , 6s"  , 6s'"  

R63co3i(i  + R'6k'cosiJ,'  + R"6s"cosi;,"  + R'"  6s'"  cosi^'"  + ... 

- i6L  t A^6Lj  + + ^3*^3  * 

et  S y ajouter  la  condition  que  les  X sont  tous  neqatifs.  Ou  bien,  si  I'on 
veut  oviter  de  conslderer  les  X comroe  neqatifs,  on  peut  faire 

R6sco3i()  + R*6s'cosi)/'  + R"6s''cosi)/“  + R'"  6s"' cosi),"*  + ... 

- -(X6L  + Xj6L^  + ’ 

alors  tous  les  X seront  positifs.  Il  est  evident,  par  la  derniere  equation, 
comrae  par  celle  qui  la  precede,  que  le  moment  R6scosi|)  + R'6s'cos\)i'  + R"6s"cosi(," 
+ R'"  6s'"  cos^"'  + ....  sera  negatif  ou  zero  toutes  les  fois  que  les  fonctions 
6L,6Lj,6L2,6Lj, . . . . seront  positives  ou  zero. 
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En  transportant  tous  les  termes  d'un  meme  cote,  I'equation  de  I'equilibre 
des  forces  perdues  deviendra 

(16)  R6scosi1i  + RMs'cos^'  + R"'Ss''cosiij"  + R'"  6s'"  cos^'"  + 

+ A6L  + A^6l^  + " ^ 

elle  doit  avoir  lieu  quelles  que  soient  6s,  6s ' , 6s" , 6s'"  tant  en  qrandeur 

quc  pour  la  direction.  Mais  il  ne  faut  pas  oublier  d'ajouter  a I'equation  (16) 
les  inegalites 

r A >0 


Ostrogradsicy  made  two  errors.  One  consists  in  the  declaration  without 
proof  of  the  assertion  of  Far)<as'  theorem.  (In  this  respect  Ostrogradsicy ' s authority 
was  so  strong,  that  many  authors  tool?  it  for  granted  [58,59,64,75)).  The  second  error 
was  discovered  by  Study  as  communicated  by  Mayer  (58,  p.225).  On  page  583  of  (59) 
Ostrograds)cy  infers  that  some  of  his  inequalities  should  be  equal  to  zero  at  the 
equilibrium.  This  would  have  made  it  possible  to  determine  the  multipliers  in  the 
equation  of  equilibrium.  He  thought  that  those  inequalities  should  be  equal  to  zero 
which  would  turn  out  to  be  negative  if  we  did  not  have  the  other  constraints.  Hamel 
gave  a counterexample  for  this  in  (47,  p. 41-42]. 
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7 . The  work  of  Farkaa  on  the  problem  of  equilibrium 


The  two  papers  113,14)  being  essentially  the  same,  we  choose  the  German  version  [141 
rather  than  the  Hungarian  for  our  quotation.  In  the  introductory  part  of  the  paper  we 
read  the  following: 

"In  diesem  besteht  das  Fourier' sche  Princip.  Ich  werde  dasselbe  auch 
Ungleichheits-Principi,  hingegen  das  gewohnliche  das  Gleichheits-Princip,  nennen. 

Das  letztere  ist  in  dem  ersteren,  als  allgemeinerem  enthalten,  denn  in  dem  Falle, 
dass  der  Zwang  durch  blosse  Gleichungen  ausgedruckt  werden  kann,  reducirt  sich 
das  Ungleichheits-Princip  auf  das  Gleichheits-Princip:  nainlich  in  dem  Gleichheits- 
Zwange  entspricht  einer  jeden  virtuellen  Verruckung  auch  die  entgegensetzte,  dann 
kann  aber  die  virtuelle  Arbeit  nur  auf  die  Weise  keinen  positiven  Wert  annehmen, 
dass  sie  verschwindet. 

So  wie  das  Gleichheits-Princip,  ist  auch  das  Ungleichheits-Princip 
unabhangig  von  den  Eigenheiten  der  verschiedenen  Punkt-Koppelungen,  und  eben 
deshalb  ist  GALILEI  als  der  Erfinder  des  Gleichheits-Princips  anzusehen,  well 
dieses  Princip  vor  ihm  nur  fur  eine  gewisse  Zusammensetzung  und  fur  solche,  die 
leicht  auf  diese  zuruckgef iihrt  werden  konnen,  aufgestellt  wurde,  namlich  von 
APISTOTELES,  und  nachdem  es  durch  eine  sehr  lange  Zeit  in  Vergessenheit  gerathen 
war,  von  UBALDI  fu'r  hebelartige  Zusammensetzungen.  Die  Verwertung  des  Princips 
erfordert  aber  selbstverstandlich  die  Berucksichtigung  Jer  Art  und  Weise  der 
gegebenen  Punkt-Koppelungen  wenigstens  dermaassen,  dass  auf  dem  Grunde  der 
zugehoVigen  Kinematik  die  entsprechenden  Zwangs-Ausdrucke  aufgestellt  werden 
konnen.  Ueber  diese  Forderung  hinaus  ist  die  An:  sndung  des  Gleichheits-Princips 
seit  LAGRANGE  bloss  eine  Sache  der  reinen  Analysis  und  insbesondere  ein  Problem 
der  Auflosung  von  Gleichungen,  welche  jedesmal  nach  bereits  aufliegenden 
Verfahrungsmethoden  dargestellt  werden  konnen. 

Mit  dem  Ungleichheits-Princip  ist  es  nicht  so  weit  gekoiranen.  Von  seinem 
Erfinder,  FOURIER,  wurde  nur  sein  genetischer  Zusammenhang  mit  alteren  Principien 
eroVtert.  Die  genze  diesbezuijliche  Abhandlung  von  FOURIER  ist  unbeachtet 


-22- 


brc'issiq  Juhro  spater  warde  das  Princip  von  GAUSS  wi#jdrir  cjufqesLellt, 


/ 

) 


Oder  vielmehr  -.'infach  ausqesprochon  in  dom  kurzen  Aufsatze  uher  das  Princip  dcs 
kleinsten  ?.wanges.  p:irj  paar  Jahre  skater  befasste  sicb  noch  der  russische 
Mathr*matiker  OSTKfXiW^DSKY  mit  dem  Princip;  er  hatte  dessen  Anwendunqen  in  Anqriff 
qeriommon,  er  hat  aber  das  Princip  nicht  in  jener  qanzen  Allqemoinheit  aufqefasst, 
wolchc  demselbon  beiqeleqt  werden  kann,  da  er  nur  eine  qewisse  KJasse  der  Zwanqs- 
V'-rhaltnisse  vor  Auqen  hielt#  jene,  in  welcher  die  Anzahl  der  Zwanqs-Ausdrucke 
diejeniqe  der  virtuellen  Verruckunqs-Componenten  nicht  Tibertri f f t;  auf  diese 
Weise  haben  sich  seine  Betrachtanqen  auf  einon  verbal tnissmassiq  sehr  kleinen 
Gultiqkeits-Bereich  beschrankt.  Wie  es  scheint  hat  sich  sonst  Niemand  mit  der 
Anwendunq  des  Princips  abqegeben,  und  es  scheint  soqar  auch  die  Meinunq  vor  zu 
walten,  dass  das  Princip  nicht  nutzbar  sei.  Dasselbe  hat  sozusaqen  nur  einen 
ieeren  Ruf  beibehalten." 

"Der  Mauptzweck  vorliqender  Arbeit  ist  zu  erweisen,  dass  mit  einer  passenden 
Modification  die  Methode  der  Multipl icatoren  von  LAGRANGE  auch  auf  das 
FOURIER' sche  Princip  iibertraqen  werden  kann." 

In  the  first  section  of  the  paper  he  deals  with  his  inequality  theorem.  That 
proof  la  incomf>lete,  however,  as  we  pointed  out.  In  the  second  section  the  necessary 
condition  of  equilibrium  is  derived: 


...sollctn  die  Zwanqs-Auadriicke  in  die  folgenden  ubergehen; 

j:F6q  * 0,  TSM  « 0,.. 


11) 


ZS^q  ^ 0,  ZTf,q  ^ 0, . . . 

'i/id  die  principielle  f’ngleichhoit  soli  heissen 

JiQfSq  ^ 0 Oder  ^ 12) 

Die  Zwangs-Gle ichunqen  sollen  auch  in  der  Form  von  Unqleichheiten  aCisgedruckt 
werden,  so  dass  das  System  der  Zwanqs-Ausdrucke  erscheint  wie  folqt: 

ZFiSq  ^ 0,  ^ 0,  . . , , 

-EF^q  ^ 0,  -TGrSq  ^ 0,  . . . , 13) 

rs^q  ^ 0,  LT-^q  0,  . . . 
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tos  FOURIER'sche  Princip  verlanqt,  dass  dit-  tJnqloichhfcit  (12)  von  allerj 


Wnrtsystnmen  dnr  'iq  bffriediqt  wird,  wolche  (13)  befriediqcTi.  Dies  qeschielit 
aber  nur,  wie  erwtesen,  wenn  es  jjositive  Multiplicatoren  qiebt,  vermoqe  dc-ren 
die  Coef f icienten  als  lineare  iiomoqene  Functionen  dor  Co<5’f f icienten 

F,  G,  . . . , -F, -r;, . . . , S , T, . . . darqestellt  werden  )<onnen.  Diese  [xisitiven 
Multiplicatoren  sollen  mit  ■/i ' ,i(i ij;"  X , u . bezeichnot  werden. 

Man  muss  haben 

- Q - W - i^")F4  (((/'  ~ iti")C  * ...  eX.qtuTt... 

Nun  Konnen  aber  die  Differenzen  ~ auch  neqative  Werte 

annehmen,  folqlich  wird  das  FOlJRIER'sche  Princip  von  jenen  Q-Werten  erfullt, 
welche  dutch  Gleichunqen  wie 

Q+^F  + i);G+...+X.qtuTt.-.*0,  14) 

sich  bestiimen  lassen,  wo  ./!, ij/ , . . . , X ,ii , . . . in  dem  Ausdrucke  einer  jeden  0"'3rosse 
dieselben  Werte  haben  und  dabei  sind  41,1(1,...  an  sich  qanz  wil  lltu’rl  ich,  X,u,... 
aber  wil llcurl iche  nichtneqati ve  QuantitaTten.  Umqe)tehrt,  aus  dem  .Gysteitw!  (14)  folqt 
mittels  des  Systems  (11)  die  principielle  Unqleichheit  (12)  dutch  ein  leicht  zu 
erltennendes  Verfahren." 

In  a further  section  of  the  paper  "the  two  main  types  of  application"  are 
presented:  a.)  the  equilibriiim  equation  for  tanqential  solid  bodies;  b.)  the 

equilibrium  equation  for  non-solid  bodies. 

H.  On  the  constraint  qualification 

The  "constraint  qualification"  is  of  fundamental  im(>ortance  not  only  from  the  f)oint 
of  view  of  nonlinear  optimization  but  from  the  point  of  view  of  mechanics  too.  Soon 
we  shall  see  why. 

In  the  beqinninq  of  this  century  the  axiomatic  foundation  of  the  mathematical  and 
physical  sciences  became  an  important  activity.  In  his  famous  paper  {491  Hilbert  urqes 
mathematicians  to  axiomatize  two  "physical  disciplines":  probability  theory  and 
mechanics.  The  paper  of  Hamel  (4f)|  of  1909  is  the  first  serious  attempt  in  the 
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direction  of  the  axiomatic  foundation  of  the  classical  mechanics.  The  Fourier 
inequality  principle  is  unfortunately  not  included.  An  imT)roved  version  of  his 

axiomatics  is  contained  in  his  paper  [471  which  apf>eared  in  1927.  There  the  inequality 

principle  of  Fourier  is  already  mentioned  as  one  of  the  axioms:  Axiom  II  2k  on  paqe  17. 
On  paqe  33  concerninq  "Das  Enerqieprinzip",  Axiom  II  5cB  declares  denotinq  by  V 
the  potential,  that  6lJ  > 0 is  a necessary  condition  of  the  equilibrium.  Hamel  had  to 
establish  consistency  between  the  two  axioms  and  this  could  only  be  done  by  a "constraint 
qualification;"  in  fact  we  find  it  in  Axiom  II  5cy,  on  paqe  33.  It  requires  that 
to  every  mass  particle  there  corres[X5nd  a scalar  function  u such  that  the  followinq 
equality  holds: 

(b.l)  ^11=  ;idmVu6r, 

where  dm  denotes  the  mass  and  r the  state  of  a particle.  If  Instead  of  (6.1) 
we  require 

(6.2)  6U  = 7U6r, 

where  r denotes  the  state  of  the  whole  system  of  particles,  then  we  obtain 
essentially  the  Kuhn-Tucker  constraint  qualification.  (6.2)  implies  (6.1)  because 
we  can  qenerate  the  u functions  for  the  purpose  of  satisfyinq  (6.1)  in  such  a way 
that  in  U we  subsequently  fix  all  variables  except  for  those  belonqinq  to  one 
particle. 

Unfortunately  Hamel  was  unaware  of  the  existence  of  Farkas'  theorem.  Even  in 
his  Theoretische  Mechanik  (first  published  in  1949)  this  theorem  is  not  referred  to, 
thouqh  part  of  the  paqes  69-70,  517-518  are  devoted  to  the  Fourier  inequality 
principle.  There  we  also  see  that  h<s  "constraint  qualification"  is  not  exactly 
derived  and  his  reasonlnq  concerninq  the  Fourier  principle  is  more  heuristic. 

9 . Miscellaneous  remarks  concerninq  linear  inequalities 


Farkas’  most  important  results  concerninq  the  Fourier  principle  and  the  theory 
of  linear  inequalities  arc  sumnarized  in  his  papers  (13,14,23). 


The  parametric  representation  of  the  solutions  of  linear  inequalities  was 


initiated  by  Fourier  ( 35] . Minkowski  gave  the  representation  of  all  solutions  using 

extremal  rays  [60).  In  the  parametric  representation  given  by  Farkas  [19,231,  the 

generation  of  the  rays  the  convex  combinations  of  which  constitute  all  solutions  of 

the  linear  inequalities  is  particularly  simple.  Writing  z.,...,z  instead  of 

1 n 

dx,,...,dx  in  (4.5)  and  (4.6),  we  can  represent  all  solutions  of  (4.5)  in  a para- 
i n 

metric  form,  insert  it  into  (4.4)  and  if  the  number  of  variables  and  the  active  con- 
straints in  (4.5)  is  not  large,  we  can  solve  the  equilibrium  problem  in  some  cases. 

For  this  we  have  to  know  which  are  the  active  constraints  in  (4.5).  This  method  was 
advised  by  Farkas  [ 191 . The  application  of  the  Farkas  parametric  representation 
technique  for  linear  programming  is  perhaps  best  done  as  in  the  paper  by  Uzawa  [ 74l 
He  completes  one  inequality  to  equality  (if  necessary) , eliminates  the  right  hand 
side  non-zero  constants  from  the  other  constraints,  inserts  the  parcunetric  form  of 
the  solutions  of  these  into  the  remaining  equality  and  the  objective  function  and 
finds  the  optimal  solution. 

The  papers  (21,22)  published  in  Hungarian  and  German,  respectively,  have  the 
same  content.  Farkas  gave  further  mechanical  application  of  his  theorem  on  linear 
inequalities.  This  concern  the  decomposition  of  the  forces  of  reaction  in  a 
mechanical  system  into  shocks  and  others  satisfying  the  negatives  of  the  constraints 
given  for  the  displacements  (Voss  mentions  in  [75,  p.75)  that  this  kind  of  distinction 
between  the  forces  is  attributed  to  Painleve).  The  excerpted  mathematical  results  of 
the  paper  is  reproduced  in  [231.  The  book  [201  published  in  Hungarian  does  not  con- 
tain new  results  as  compared  to  his  earlier  papers  and  to  the  paper  [23l. 

Between  1902  and  1917  Farkas  did  not  publish  on  linear  inequalities.  In  1917, 
after  Haar  generalized  Farkas'  theorem  for  the  inhomogeneous  case,  Farkas  returned 
to  the  area  and  published  further  papers  (28,29,311  on  systems  of  linear  inequalities. 
The  papers  [25,26,27,301  are  also  partially  relevant;  [301  is  the  German  version  of 
(251. 


-26- 


Haar  wrote  three  papers  on  linear  inequalities  (42,43,441.  The  first  two  are 
essentially  the  Hungarian  and  German  versions  of  the  same  paper.  He  gave  the  following 


I 


i 


generalization  for  Farkas'  theorem  (we  shall  use  the  notation  of  Section  3). 

Theorem  6.1.  If  the  linear  inequality 
(6*1)  g ' X ^ b 

is  a consequence  of  the  linear  inequalities 

(6.2)  g!x  > b.,i  = 1,...,M 

i.e.  every  x satisfying  (6.2)  also  satisfies  (6.1),  then  there  exist  nonnegative 
constants  such  that  for  every  x f r”  we  have 

M 

(6.3)  g'x-b  = )X,(q!  x-b.)+X. 

IX  I 

1*1 

This  is  the  same  statement  referred  to  by  Kuhn  and  Tucker  in  a footnote  supplied  to 
von  Neumann's  manuscript  (61).  This  concerns  the  duality  theorem  of  linear  progranming 
proved  by  Gale,  Kuhn  and  Tucker  137|. 

Haar  remarked  (42,44),  that  the  theory  of  linear  inequalities  was  developed  by 
Farkas  and  Minkowski.  The  famous  book  of  Minkowski  (60)  contains  results  also  on 
linear  inequalities  (pages  39-45  in  both  editions).  He  considered  a finite  system 
of  homogeneous  linear  inequalities  from  two  |K>ints  of  view:  to  represent  them  in  a 
parametric  form  and  to  discover  those  which  are  superfluo’iS  i.e.  can  be  omitted 
without  changing  the  set  of  solutions.  This  latter  problem  led  him  to  prove  a theorem 
closely  related  to  Farkas*  theorem  mentioned  in  Section  3.  For  the  sake  of  complete- 
ness we  present  here  the  exact  statement  of  Minkowski's  theorem. 

We  assume  that  in  the  system  (3.1)  the  number  of  linearly  independent  relations 
equals  n,  the  number  of  components  of  x.  This  does  not  restrict  the  generality, 
as  Minkowski  remarked.  An  x is  said  to  be  an  extremal  ray  of  the  cone  (3.1)  if 
X is  not  the  sum  of  two  nonzero  vectors  which  satisfy  (3.1)  and  neither  of  them  is 
a constant  multiple  of  the  other. 
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Theorem  6.2.  Out  of  the  linear  forms  gl^x  iO,i  = those  which  are 

m - 1 linearly  independent  extremal  solutions  have  the  property  that  each  of  them 
is  essential  and  all  other  forms  can  be  expressed  as  their  linear  combinations  with 
nonnegative  weights. 

For  further  references  to  early  papers  on  linear  inequalities  see  19). 
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